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'^ Abstract. The concept of qualification for spectral regularization methods (SRM) 

t--5 for inverse ill-posed problems is strongly associated to the optimal order of convergence 

iy-\ of the regularization error ([2], [5], [G], [11]). In this article, the definition of 

OQ qualification is extended and three different levels are introduced: weak, strong and 

^_^ optimal. It is shown that the weak qualification extends the definition introduced 

.^ by Mathe and Pereverzev ([(>]), mainly in the sense that the functions associated 

to orders of convergence and source sets need not be the same. It is shown that 
certain methods possessing infinite classical qualification, e.g. truncated singular 
value decomposition (TSVD), Landweber's method and Showalter's method, also 
have generalized qualification leading to an optimal order of convergence of the 
S regularization error. Sufficient conditions for a SRM to have weak qualification are 

provided and necessary and sufficient conditions for a given order of convergence to 
T— I be strong or optimal qualification are found. Examples of all three qualification levels 

^ are provided and the relationships between them as well as with the classical concept 

f.^ of qualification and the qualification introduced in [d] are shown. In particular, SRMs 

^^ having extended qualification in each one of the three levels and having zero or infinite 

'^ classical qualification are presented. Finally several implications of this theory in the 

t~^ context of orders of convergence, converse results and maximal source sets for inverse 

^^ ill-posed problems, are shown. 
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1. Introduction and preliminaries 

Let X, Y be infinite dimensional Hilbert spaces and T : X — )■ F a bounded linear 
operator. If TZ{T), the range of T, is not closed it is well known that the linear operator 
equation 

Tx = y (1) 

is ill-posed, in the sense that T^^, the Moore- Penrose generalized inverse of T, is not 
bounded [2]. The Moore- Penrose generalized inverse is strongly related to the least- 
squares (LS) solutions of (1). In fact equation (1) has a LS solution if and only if y 
belongs to P(T'''), the domain of T\ which is defined as P(T"'') = TZ{T) © TZ[T)^. In 
that case, x^ = T'^y is the best approximate solution (i.e. the LS solution of minimum 
norm) and the set of all LS solutions of (1) is given by x^ +Af{T). If the problem is 
ill-posed, then x'^ does not depend continuously on the data y. Hence if instead of the 
exact data y, only an approximation y^ is available, with |||/ — y'^|| < 5, where 5 > is 
the noise level or observation error, then it is possible that T'^y^ does not exist or, if it 
exists, then it will not necessarily be a good approximation of x^, even if S is very small. 
This instability becomes evident when trying to approximate x^ by standard numerical 
methods and procedures. Thus, for instance, except under rather restrictive conditions 
([1], [12]), the application of the standard LS approximations procedure on a sequence 
{Xn} of finite dimensional subspaces of X, whose union is dense in X, will result in a 
sequence {x„} of LS approximating solutions which does not converge to x^ (see [9]). 
Moreover, this divergence can occur with arbitrarily large speed (see [10]). 

Ill-posed problems must be regularized before pretending to successfully attack 
the problem of numerically approximating their solutions. Regularizing an ill-posed 
problem such as (1) essentially means approximating the operator T^ by a parametric 
family of continuous operators {Ra}, where a is called the regularization parameter. 
More precisely, for a G (0, ao) with a^ G (0, +oo], let Ra '■ Y ^ X he a continuous (not 
necessarily linear) operator. The set {Ra}ae{o,ao) is said to be a "family of regularization 
operators" (FRO) for T\ if for every y G 'D(T"''), there exists a parameter choice rule 
a = a{S,y^) such that 

lim sup \\Ra(5,yS)y^ " ^"^^11 = 0. 
5^0+ yS^Y 

\\y^-y\\<S 

Here the parameter choice rule a : IR"'' x F — )■ (0, ao) is such that 
lim sup a{6,y^) = 0. 



5^0+ y/,(,Y 



\\y y\\- 



<s 



If y G ViT"^), then x^ satisfies the normal equation {T*T)x'^ = T*y and x^ can be 
written as 

xt=TV=/ -dE,T*y, (2) 
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where {-EaJagk. is the spectral family associated to the self-adjoint operator T*T (see [1], 
[2]). However, since we are assuming that TZ{T) is not closed (and therefore 'D{T'^) C y), 
if y ^ ViT'^) then the integral in (2) does not exist since in that case G a(T*T) and ^ 
has a pole at 0. Moreover in this case, the operator T''' defined in (2) for y e P(T'''), is not 
bounded. For that reason, many regularization methods are based on spectral theory 
and consist on defining Ra = /q ga{X) dExT* where {ga} is a family of functions 
appropriately defined such that for every A G (0, ||T|| ] there holds lim ^'^(A) = j. 

Let {ga}aeio,ao) bc a parametric family of functions ga '■ [0, +oo) — )■ IR defined for 
all a G (0,ao). We shall say that {fi'a}ae{o,«o) i^ a "spectral regularization method" 
(SRM), if it satisfies the following hypotheses: 

HI. For every fixed a G (0, ao), fl'a(A) is piecewise continuous with respect to A, for 
A G [0,+oo); 

H2. There exists a constant C > (independent of a) such that |A5'a(A)| < C for 
every A G [0, +oo); 

H3. For every A G (0, +oo), lim g^iX) = t- 

It can be shown that if {ga}ae{o,ao) is a SRM then the family of operators 
{Ra}ae{o,ao) defined by 

Ra = J ga{X) dExT* = ga{T*T)T*, 

is a FRO for T^ ([2], Theorem 4.1). In this case we shall say that {Ra}a£{o,ao) is a 
"spectral regularization family" for T^^. The use of this terminology has to do with the 
fact that each one of its elements is defined in terms of an integral with respect to the 
spectral family {-EaJagir associated to the operator T*T. Note that given the operator 
T, it is sufficient that 5'a(A) be defined for A G [0, ||T|| ], since Ex is "constant" outside 
that interval. 

It is well known that for ill-posed problems it is not possible to reconstruct the 
exact solution a;^ with any degree of accuracy unless additional a-priori information 
about x^ is available ([10], [2] Proposition 3.11). On the other hand, given certain a- 
priori information about x\ it could be desirable to know the best order of convergence 
(of the regularization error llRaV — x^\ as a function of the regularization parameter a, 
or of the total error ||-Rq|/'^ ^ ^^11 ^^ ^ function of the noise level 6), that can be achieved 
with a regularization method under those a-priori assumptions. Conversely, given an 
order of convergence, one could be interested in determining the possible existence of 
"source sets" on which a certain regularization method reaches that order of convergence. 
In this case it could further be of interest to determine "maximal source sets". All 
these problems are strongly related to the concepts of qualification and saturation of a 
regularization method ([2], [3], [5], ['-], ["], [8]). 

In [1 1] the notion of qualification of a regularization method was introduced for the 
first time and the decisive role of this concept in relation to the order of convergence of 
the regularization error was shown. In the sequel, we shall simply denote with {ga} the 
SRM {ga}ae{o,ao)- Wc uow recall the definition of classical qualification for SRMs (see 
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[2]). 

Definition 1.1. Let {ga} be a SRM and denote with X{ga) the set 

I{g^) = {/i> : VA G [0,+oo),3A; > such that X^" \1 - Xga{X)\ < ka^ ,\fa e (0,ao)} 

and let fiQ = sup /i. If < fio < +oo, we say that {ga} has classical qualification and 

in that case the number /ig is called "order" of the classical qualification. 

Remark 1.1. Note that G I{ga) by virtue of H2 and therefore T{ga) is always 
nonempty. 

In [6] Mathe and Pereverzev first introduced the following definition of qualification 
for a spectral regularization method, formalizing and extending the classical notion of 
the concept. 

Definition 1.2. Let p : (0, a] — )■ (0, oo) be an increasing function. It is said that the 
regularization method {ga} has qualification p if there exists a constant 7 G (0, 00) such 
that 

sup |1 - A^„(A)|p(A) < 7p(a) VaG(0,a]. (3) 

Ae(0,a] 

In this article we generalize the previous concept, mainly by allowing the function 
p(A) appearing in the left hand side of (3) to be substituted by a general function s(A) 
with similar properties. 

Remark 1.2. It is important to point out that in [ ] the "classical qualification" 
of a method was defined to be the number /iq in Definition 1.1 (even in the case 
Pq = ooj. However, from our point of view the "generalized qualification" of a method 
will not be a number but rather a function of the regularization parameter a as an 
order of convergence in the sense of Definition 1.2. In the case of SRMs with classical 
qualification of positive finite order p^, the corresponding generalized qualification will be 
shown to be the function p{a) = a'^° , coinciding with the classical approach. Since in the 
extreme cases po = and po = 00 that function does not define an order of convergence, 
we have preferred to exclude them from the definition of classical qualification (Definition 
1.1) and, accordingly, we shall say that the method does not have classical qualification. 

The organization of this article is as follows. In Section 2 the concepts of weak 
and strong source-order pair and of order-source pair are defined and three qualification 
levels for SRM are introduced: weak, strong and optimal. A sufficient condition for 
the existence of weak qualification is provided and necessary and sufficient conditions 
for an order of convergence to be strong or optimal qualification are given. In Section 
3, examples of all qualification levels are provided and the relationships between them 
and with the classical qualification and the qualification introduced in [U] are shown. 
In particular, SRMs having qualification in each one of the three levels and not having 
classical qualification are presented. Finally several implications of this theory in the 
context of orders of convergence, converse results and maximal source sets for inverse 
ill-posed problems are shown in Section 4. 
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2. Source-order and order-source pairs. Generalized qualification and 
qualification levels. 

It is well known that there exist SRMs for which the corresponding /xq given in Definition 
1.1 is infinity, e.g. truncated singular value decomposition (TSVD), Landweber's 
method and Showalter's method. However, a careful analysis leads to observe that 
the concept of qualification as optimal order of convergence of the regularization error 
remains alive underlying most of these and many other methods. In this section we 
generalize the definition of qualification introduced by Mathe-Pereverzev in [6] and 
thereby the notion of classical qualification of a SRM. Also three different levels of 
qualification are introduced: weak, strong and optimal. These levels introduce natural 
hierarchical categories for the SRMs and we show that the generalized qualification 
corresponds to the lowest of these levels. Moreover, a sufficient condition which 
guarantees that a SRM possesses qualification in the sense of this generalization is 
provided and necessary and sufficient conditions for a given order of convergence to be 
strong or optimal qualification are found. 

We denote with O the set of all non decreasing functions p : IR"*" — )■ IR"*" such that 
lim p{a) = and with S the set of all continuous functions s : lR(j" — )■ lR(j" satisfying 

a— s>0+ 

s(0) = and such that s(A) > for every A > 0. If moreover s is increasing, then it is 
an index function in the sense of Mathe-Pereverzev ([6]). 

Definition 2.1. Let p,p ^ O. We say that "p precedes p at the origin" and we denote 
it with p ^ p, if there exist positive constants c and e such that p{a) < cp{a) for every 
a e {0,e). 

Definition 2.2. Let p,p E O. We say that "p and p are equivalent at the origin" and 
we denote it with p ^ p, if they precede each other at the origin, that is, if there exist 
constants e, ci, C2, e > 0, < ci < C2 < oo such that ci p{a) < p{a) < C2 p(a) for every 
a e (0,e). 

Clearly, "«i" introduces an order of equivalence in O. Analogous definitions and 
notation will be used for s,s E S. 

Definition 2.3. Let {g^} he a SRM, r^iX) = 1 - \gc{>^), p eO and s eS. 
i) We say that {s,p) is a "weak source- order pair for {ga}" if it satisfies 

'-i^^lM^ = 0(1) /or a^0+, VA>0. (4) 

p{a) 

ii) We say that (s,p) is a "strong source- order pair for {ga}" if it is a weak source- 
order pair and there is no X > for which 0(1) in (4) can be replaced by o(l). That is, 
if (4) holds and also 

limsup^^^4^>0 VA>0. (5) 

a^o+ p[a) 



Generalized Qualification and Qualification Levels for SRM 6 



7 > and a function h : (0, ao) — )■ IR"^ with lim h{a) = 0, such that 

a-s>0+ 



iii) We say that {p,s) is an "order-source pair for {Qo}" if there exist a constant 
inction h : ( 

^i^n^>7 VAG[M«),+oo). (6) 

p{a) 

In the previous definitions we shall refer to the function p as the "order of 
convergence" and to s as the "source function" . The reason for using this terminology 
will become clear in Section 4 when we shall see applications of these concepts in the 
context of direct and converse results for regularization methods. 

The following observations follow immediately from the definitions. 

(i) If (s, p) is a weak source-order pair for {ga} which is not a strong source-order pair, 
then there exists Aq > such that lim sup ^ ° (a) ° ~ ^ ^^^ therefore (p, s) cannot 

a— >0+ 

be an order-source pair for {ga}- Thus if (p, s) is an order-source pair and (s,p) 
is a weak source-order pair, then (s,p) is further a strong source-order pair in the 
sense of ii). 

(ii) Let p,p e O. 

(a) If (s,p) is a weak source-order pair for {ga} and p ^ p then (s,p) is also a 
weak source-order pair for {ga}- 

(b) If (s,p) is a weak source-order pair for {ga} and s E S is such that there 
exists c > for which s(A) < cs(A) for every A > 0, then (5, p) is also a weak 
source-order pair for {ga}- 

In the following definition we introduce the concept of generalized qualification and 
three different levels of it. 

Definition 2.4. Let {ga} be a SRM. 

i) We say that p is "weak or generalized qualification of {ga}" if there exists a 
function s such that (s,p) is a weak source- order pair for {ga}- 

ii) We say that p is "strong qualification of {ga}" if there exists a function s such 
that (s,p) is a strong source- order pair for {ga}- 

iii) We say that p is "optimal qualification of {ga}" if there exists a function s 
such that {s,p) is a strong source-order pair for {ga} (it is sufficient that (s,p) be a 
weak source- order pair) and (p, s) is an order-source pair for {ga}- 

It is important to observe that weak qualification generalizes the concept of 
qualification introduced by Mathe and Pereverzev in [(i] and therefore, the notion of 
classical qualification. In fact, if {ga} has continuous qualification p{a) in the sense of 
Definition 1.2 and lim p{a) = 0, then the function 

Q!-S>0+ 

p(a) = < p(a), si < a < a; (7) 



0, 


si a = 0; 


p(a). 


si < a < a: 


p{a), 


si a > a. 
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is weak qualification of {ga}- However, tliese two notions are not equivalent. We shall 
see later on that it is possible for a function to be weak qualification of a SRM and not 
be qualification according to Definition 1.2 (see comments at the end of Section 3). 

It is timely to note here that if {ga} has classical qualification of order /xq, then 
p{a) = a^ is weak qualification of {(^a} and moreover (A'^, a^) is a weak source-order pair 
for {ga) for every /i G (0,/io]- Conversely, if for /i > 0, {\^,a^) is a weak source-order 
pair for {(/q,}, then this method has classical qualification (of order /xq > /i) provided 
that /io = sup \ji : {X^, a^) is a weak source-order pair for {(^a} j< +oo. 

The following result provides a sufficient condition for the existence of weak 
qualification of a SRM. 

Theorem 2.1. Let {ga} b^ o, SRM such that for every fixed A > 0, 5'a(A) is decreasing 
in a, for a G (0, ao). 

a) If there exist an increasing function h : (0, ao) ~^ IR^ with lim h(a) = 0, p* & O 

a—>0+ 

and e > such that for every a G (0, e), 

sup |r,(A)|<p*(«), (8) 

\£[h{a),+oo) 

then {ga} has weak qualification and in that case p* is weak qualification of the method. 

b) If for every a G (0,q;o), Tq,(A) is positive and monotone decreasing for A G 
(0,+oo), then it is always possible to find h and p* as in a) satisfying (8) for all 
a G (0,ao). 

Proof, a) Let h : (0, ao) — ?■ IR^ be an increasing function with lim h{a) = 0, p* E O 

a— 5>0+ 

and e > such that for every a G (0, e) condition (8) holds. 

Case I : there exists a G (0,£:) such that sup |'"a(A)| > 0. 

\£[h{a),+oo) 

Since h{a) is increasing, it follows that sup |^o(A)| > for every a G (0,5;]. 

\e[h{a),+oo) 

Let Ao > 0. Then for every a G (0, a], 
ka(Ao)| ^ \ra{Xo)\ 



p*{a) sup |r„(A)| 

Xe[h{a),+oo) 

Since lim. h{a) = 0, there exists a* G (0, a) such that Aq G [h{a), +oo) for every 
a G (0, a*], from which it follows that for every a G (0, a*], 



sup |ra(A)| 

Ae[/i(a),+oo) 



< 1. (10) 



^From (9) and (10) it follows that for every Aq > 

,. ka(Ao)| . , 
lim sup -—— < 1. 

„^o+ P*(") 

Then, for any bounded s E S the pair (s,p*) satisfies (4), i.e., it is a weak source-order 
pair for {ga}- Thus we have proved that p* is weak qualification of {ga}- 
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Case II : sup ka(A)| = for every a G {0,e). 

\£[h{a),+oo) 

Let Aq > 0. Since lim h{a) = 0, there exists a* G {0,e) such that Aq G [h{a), +oo) 
for every a G (0,a*]. Then |rQ(Ao)| < sup |^a(A)| = for every a G (0,0;*), from 

Ag[/i(q),+oo) 

what it follows that ra{Xo) = 0. Then, for any s & S, 

■s(Ao)ra(Ao) ^ /n *^ 

= for all a e (O.a . 

p*{a) 

Therefore, {s,p*) is a weak source-order pair for {ga}, which implies that p* is weak 

qualification of {ga}- (Note that in this case any p* E O is weak qualification of {ga}-) 

b) Let {ga} be a SRM such that for every a G (0,ao)! ra{\) is positive and 

monotone decreasing for A G (0, +oo). For A > we define /(A) = (1 — e~^)^(A), where 

^(A) = sup{7 G (0, ao) : r„(A) < A V a G (0, 7)}. 

Since for every A > 0, lim ra{X) = 0, it follows that given A > there exists 

a— 5>0+ 

7 = 7(A) > such that ra{\) < A for every a G (0,7). Then 9{\) 7^ —00, moreover 
^(A) G (0, ao] for every A > and therefore, /(A) G (0, ao) for every A > 0. On the other 
hand, since for every a G (0,q;o), ra{X) is decreasing for A > 0, it follows immediately 
that / is strictly increasing. Furthermore, since / is bounded, it has countably many 
jump discontinuity points. Therefore, it is possible to assume, without loss of generality, 
that / is continuous (since, if it is not, we can redefine it in such a way that it be 
continuous, by subtracting the jumps at the discontinuity points). 

Thus / : IR"*" — > (0,ao) is continuous, strictly increasing with lim /(A) = 0. 

Therefore, its inverse function f~^ exists over the range of / and it is strictly increasing 
and continuous with lim f~^{a) = 0. It is possible to extend f'^ to (0, ao) in such a 

a— >0+ 

way that it preserves all these properties. We shall denote with h this extension. 

For a G (0,ao)) we define z{a) = sup |^a(A)| = ra{h{a)). Since for every 

\e[h{a),+oo) 

a G (0,q;o)) ''"a(A) is positive for all A > 0, it follows that z{a) is also positive. Since 
for every A > 0, /(A) < ^(A), the definition of ^(A) implies that rj(A)(A) < A for every 
A > 0, or equivalently, ra{h{a)) < h{a) for every a G (0,ao)- Then < z{a) < h{a) 
for every a G (0, ao) and the fact that lim h{a) = implies that lim z{a) = 0. If 

further z is a non decreasing function, then z E O and it suffices to define p* = z. On 
the contrary, since z is bounded and positive with lim z{a) = 0, there always exists a 

function p* E O such that z{a) < p*{a) for every a G (0, ao), as we wanted to show. ■ 

/^From the previous Theorem, it follows that the SRMs {ga} such that for every 
A > 0, 5'a(A) is decreasing for a G (0,ao) and for every a G (0,ao), ra{\) is positive 
and decreasing for A > 0, do possess weak qualification. It is important to observe that 
most of the usual SRMs do in fact satisfy these conditions. In particular this is so for 
Landweber's and Showalter's methods. 
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Now given the SRM {ga} and p E O, we define 

sJX) = liminf/^ for A > 0. (11) 

a^o+ |r„(A)| 

Note that Sp{0) = 0. 

In the next three results we will see that the characteristics of a given function 
p G (9, as a possible strong or optimal qualification of a SRM, can be determined from 
properties of that function Sp. 

Proposition 2.1. (Necessary and sufficient condition for strong qualification.) A 
function p E O such that Sp E S is strong qualification of {ga} if o-nd only if 

< Sp{X) < +00 for every A > 0. (12) 

Proof. Suppose that p is strong qualification of {ga}- Then there exists a function s E S 
such that (s,p) is a strong source-order pair for {ga}- Then, for every A > 0, 

(\\ = V ■ f_P(^ = 1 ^ s{X) 

'"^^^ Tir|r.(A)| hmsup^ limsup^^^)^' 

Thus (12) follows from (4) and (5). 

Conversely, suppose now that < Sp(A) < +oo for every A > 0. We will show that 
p is strong qualification of {ga}- For that let us see that {sp,p) is a strong source-order 
pair for {ga}- Since < Sp{X) < +oo for every A > 0, it follows that 



— = Sp{X) hmsup — -- 

a^0+ Pl"j a^0+ Pl"j 



hmsup ^ =Sp(A)limsup =1 V A > 0. 



Then, Sp verifies (4) and (5), which, together with the fact that Sp G S, implies that 
{sp,p) is a strong source-order pair and thus p is strong qualification of {ga}- • 

Proposition 2.2. Let p E O be strong qualification of {ga} and s G 5. Then {s,p) is a 
strong source- order pair for {ga} if and only if there exists k > such that s{X) < k Sp{X) 
for every A > 0. 

Proof. Since p is strong qualification, by Proposition 2.1 it follows that Sp{X) > for 
every A > . Suppose now that (s, p) is a strong source-order pair for {ga}- Then there 
exist positive constants k and e such that ^^ "l^!" " < k for every A > 0, a G (0,6:). 
Then, for every A > 

4^ = .(A) hmsup ^^ = hmsup ^iM!i^ < k^ 
Sp{X) „^o+ P(") a~^o+ P(a) 

and therefore s(A) < ksp{X) for every A > 0. 

Conversely, suppose that there exists A; > such that s(A) < ksp{X) for every 
A > 0. Since Sp{X) > 0, it then follows that 

sW , s(A)|r„(A)| ^, 

k> -^-^ = limsup ^ , , ^' VA>0, 
■Sp(A) a^o+ P(a) 
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that is, (s,p) is a weak source-order pair for {ga}- Moreover since s(A) and Sp{X) are 
positive for all A > 0, it follows that s(A) verifies (5) and therefore (s,p) is, furthermore, 
a strong source-order pair for {ga}- B 

Theorem 2.2. (Necessary and sufficient condition for optimal qualification.) A 
function p ^ O such that Sp & S is optimal qualification of {ga} if (I'^d only if Sp 
verifies (6) and (12). 

Proof. Suppose that p is optimal qualification. Then p is strong qualification and 
it follows from Proposition 2.1 that Sp verifies (12). Moreover since p is optimal 
qualification, there exists s & S such that (s, p) is a strong source-order pair and (p, s) 
is an order-source pair. From the latter it follows that there exist a constant 7 > and 
a function h : (0, ao) -^ IR-^ with lim h{a) = 0, such that 

a—^0+ 

■^2^1Mm>^ WXe[hia),+oo). (13) 

p{a) 

On the other hand, since {s,p) is a strong source-order pair for {ga}, it follows from 
Proposition 2.2 that there exists A; > such that 

s(A) < ksp{\) for every A > 0. (14) 

IFtoiu. (13) and (14) it follows that 

Sp{\)\ra{X)\ 7 w \ ^ r^r ^ ^r^\ 

>- \f Xe[h{a), +00), 

p[a) k 

that is, Sp satisfies (6) as we wanted to show. 

Conversely, suppose that Sp E S verifies (6) and (12). By Proposition 2.1 we have 
that {sp,p) is a strong source-order pair for {ga} and (6) implies that {p,Sp) is an 
order-source pair. Then, p is optimal quahfication of {ga}- B 

Next we will show the uniqueness of the source function. 

Theorem 2.3. If p is optimal qualification of {ga} then there exists at most one function 
s (in the sense of the equivalence classes induced by Definition 2.2) such that {s,p) is a 
strong source-order pair and [p, s) is an order-source pair for {ga}- Moreover if Sp G S, 
then Sp is such a unique function. 

Proof. Given that p is optimal qualification of {ga}, there exists at least one function s 
such that (s,p) is a strong source-order pair and (p, s) is an order-source pair for {ga}- 
Suppose now that there exist Si and S2 such that (si,p) and (s2,p) are strong source- 
order pairs and (p, si) and (p, S2) are order-source pairs for {ga}- Then there exist 7 > 
and a function h : (0, Oq) — )■ IR"^ with lim h{a) = 0, such that '^^ y\ > 7 for every 

A G [/i(a),+oo). Then, 

si(A)s2(A)|rQ(A)| 

^■(^)= «,;iK,>ll ^'^ ,i.f" VAe|M„),+o=),V„e(0,a„). (15) 
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On the other hand, since (si,p) is a strong source-order pair, there exist positive 
constants k and e such that 

gi(A)|r^(A)| ^^ VA>0,VaG(0,£). (16) 

p{a) 

From (15) and (16) it follows that 

k 
Si(A) < -S2(A) VA G [h{a),+oo),ya G (0,£). 

7 

Since lim h{a) = we have that si(A) < -S2(A) for every A > 0. Analogously, by 

interchanging si and S2 it follows that there exists k > such that S2(A) < A;si(A) for 
every A > and therefore, Si ~ S2. 

Suppose now that Sp G S. Since p is optimal qualification of {ga} it follows from 
Theorem 2.2 that Sp verifies (6) and (12). Then, Sp is the unique function such that 
{sp,p) is a strong source-order pair and {p,Sp) is an order-source pair for {ga}- • 

The following is a result about the uniqueness of the order. 

Theorem 2.4. // (s,pi) and {s,p2) are strong source-order pairs for {ga} o-nd there 
exists lim ^4^, then pi ~ P2- 



Proof. Suppose that (s,pi) and (s,p2) are strong source-order pairs for {ga}- We will 
im suf 



first show that hmsup^4^ > 0. Suppose that 



limsup^4^ = 0. (17) 

,0+ P2[a> 



«—!>(, 



Since (s,pi) is a strong source-order pair we have that 

^(A)MA)| ^^ ^^^ a^0+, VA>0 
pi(a) 

and 

n^,. ^(A)|r.(A)| s(A)K(A)|pi(«) 

< lim sup — — = lim sup 



>o+ P2{a) a^0+ Pil") P2[a) 

It follows from (17) and (18) that the lim sup on the right-hand side of the previous 

expression must be equal to zero, which is a contradiction. Then, limsup^^4^ > 0. 

Similarly, it is shown that lim sup ^4\ > 0. Since there exists lim ^4^, we then have 

that < lim ^4^ < +oo and < lim ^4^ < +oo. Then, pi -< Oo and P2 ^ Pi, that 
is, pi ~ P2, as we wanted to show. ■ 
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3. Examples 

In this section we present several examples which illustrate the different qualification 
levels previously introduced as well as the relationships between them and with the 
concept of classical qualification and the qualification introduced in [(>]. Although some 
of these examples are only of academic interest and nature, they do serve to show the 
existence of regularization methods possessing qualification in each one of the levels 
introduced in this article. 

Example 1. Tikhonov-Phillips regularization method {ga}, where 5'a(A) = j^ 
has classical qualification of order /io = 1 ([ ])• We will see that p{a) = a is optimal 
qualification in the sense of Definition 2.4 iii). In fact, for A > 0, ra{X) = -^^^ and if 

111111111 mill ^ -*- "^'^ — \ ^ n fVio+ ic o TroT-ifidc 



p{a) = a then Sp{X) = liminf r^^^ = lim(A + a) = A > 0, that is, Sp verifies (12). Also 



smce 



— > - V A G [a, +OOJ 



p{a) A + a 2 

we have that Sp verifies (6). From Theorem 2.2 it then follows that p(a) = a is optimal 
qualification of {go}- 

Example 2. Let {go} be the family of functions associated to the truncated 
singular value decomposition (TSVD), 

„ (^^^\ h if Ae [a,+oo) 
^"^ ^ \ 0, ifAe[0,«). 

It follows that po = +00, where po is as in Definition 1.1. Therefore, TSVD does not 
have classical qualification. In this case we have that 

^ MA_ / 0' if A^ [a,+oo) 
°^ ^ \ 1, ifAG[0,«). 

Let h{a) = a and p E O. Then 

sup I'^alA)! = sup |rQ,(A)| = < p(a) for every a G (0,q;o). 

X£[h{a),+oo) X>a 

Then, it follows from Theorem 2.1. a) that any function p E O is weak qualification 
of the method. However, TSVD does not have strong qualification. In fact, for any 
function p E O we have that Sp{\) = liminfr^^^4^ = +oo for every A > 0. Proposition 

2.1 implies then that p is not strong qualification of the method. In [(>] it was observed 
that TSVD has arbitrary qualification in the sense of Definition 1.2. 

Example 3. For a G (0,q;o) we define 

1 — e^Q 

5'q(A) = T! for every A G [0, +oo). 

A + e~a 
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It can be immediately verified that {ga} satisfies the hypotheses H1-H3 and therefore 
is a SRM. Since ra{X) = ^"'"\ for all A G [0, +00), it follows that for every fi > 0, 

l+Xea 

I \ \ \ u 

0(1) for a -> 0^ for every A G [0, +00). 



l+A 

1 

+Aeo 

|r,(A)|A'^ (1 + A)A^ 



«'' Xe^a^' + a^' 

Then, {g^} does not have classical qualification (more precisely /io = +C)0, where /xq is 
as in Definition 1.1). 

We will now show that p(a) = e~Q is optimal qualification of {ga}- Since 
Sp{X) = liminfr^^^ = j^ E (0, +00) for every A > 0, it follows from Proposition 

2.1 that p is strong qualification of {ga}- Moreover since 

SpiX)\ra{X)\ X 1 >, ^ ^ r -1 , _^ 

p{a) X + e-^ 2 

it follows that Sp verifies (6). Theorem 2.2 then implies that p{a) = e~^ is optimal 
qualification of {ga}- 

Example 4. For a G (0,ao) with ao < e~"^, define 

,^, . 1 + (Ina)"^ „ ^ ,r. \ 

9a{X) = T 7. ^-r, for every A G 0, +00). 

A — (Ina)"^ 



l+A 



Clearly, {ga} satisfies hypotheses H1-H3 and therefore is a SRM. Since ra{X) — i_xina 
for all A G [0, +00), it follows that for every p > 0, 

|r,(A)|A'^ (1 + A)A'^ ^ ,^ X rn N 

- — -^ = — ^ — r — —^ ;■ +00 for a -)■ 0^ for every A G 0, +00). 

Q,/i a^ — Aa^ma 

Then, po = and therefore {ga} does not have classical qualification. 

However, we will show that p{a) = — (lna)~^ is optimal qualification of {ga}- In 
fact, since Sp{X) = liminf , ^j^.. = lim ~,°? — = ttt ^ (0, +C)o) for every A > and 

a — >-0^ " cv — >0 

So(X) |rcv(A)| A 1 , , > r /, N 1 

'^ f = X n \ 1 ^0 VAg -ln«r\+oo, 
p[a) X — (In a) ^ 2 

it follows from Theorem 2.2 that p{a) = — (Ina)"^ is optimal qualification of {ga}- 

Example 5. Let {ga} be the Tikhonov-Phillips regularization method, which, as 
previously mentioned, it has classical qualification of order pq = 1. In Example 1 we 
saw that p{a) = a is optimal qualification of this method and therefore it is also weak 
qualification of it. Since a ^ a^ it follows from Definition 2.4.i) and Observation 2. a) 
that p*{a) = aa is also weak qualification. However, p* is not strong qualification of 
the method. In fact, for any s G 5, we have that 

s(X) \ra(X)\ , s(X) a2 ^ , ^ 

limsup ^ ^' "; ^' =limsup ^ ' =0 V A > 0. 
a^o+ p*[a) a^o+ a + A 

Example 6. Let {ga} be the SRM defined in Example 4. This method does 
not have classical qualification since p^ = 0. We proved that — (lna)~^ is optimal 
qualification and therefore, it is also weak qualification. Since — (Ina)^^ ^ (—In a)" 2, 
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just like in the previous example, it follows immediately that p{a) = (—In a)" 2 is weak 
qualification. Let us show now that p is not strong qualification of the method. For any 
s G iS, we have that 

lim sup —- = lim sup ^ = V A > 0. 

a^o+ P(«) a^o+ (1 - Alna) (-lna)"2 



It is important to observe that if p{a) = a^ is strong qualification of a SRM then 
it follows immediately from the definition of strong source-order pair that the method 
has classical qualification of order p. The converse, however, is not true as the next 
example shows. Hence it is the weak and not the strong qualification what generalizes 
the classical notion of this concept. 

Example 7. For a G (0,a;o) with Oq < 1/2 define 



and 



KiX) = 



9aiX) = 



a 



« + M^) 



l-/ta(A) 

X+hc(\) 



if A G [2a, +00) 
S^=(2«-^)"\ if AG [0,2a). 



In this case, 



a(l+A) 



r„(A) = 



^1°(iJTa)+"(1+^)^ 



if A G [2a, +00) 



1-A(2a-^) , if AG [0,2a). 



One can immediately show that {ga} is a SRM with classical qualification of order 
Pq = 1. However, p{a) = a is not strong qualification of the method. In fact, for any 
s G 5, we can see that 

^(A)MA)| ^ fora-.O^VA>0 

a 
and therefore condition (5) is not satisfied. 

SRMs possessing strong but not optimal qualification, have very peculiar properties. 
Thus for instance, it is possible to show that if p is strong qualification which is not 
optimal, then VA > 0, the function ^^ (^\ it is not of bounded variation as a function 
of a in any neighborhood of a = 0. Even so, the following three examples show the 
existence of SRM having strong but not optimal qualification and they show that strong 
qualification in no case implies optimal qualification. 

Example 8. Given k G IR"*", for a, A > define 

g^^{X) = X-\l - e"^) - a^X-^^^ sin(Ai/a) 
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so that r^(A) = e <» + a'^X ^/^ sin(A2/a) . It can be immediately checked that {g'^} is 
a SRM with classical qualification of order k. With p{a) = a^ we have that VA > 0, 



Sp(A) = liminf 




limsupfa ^e q+A ^/^ sin(A2/a) 

^_>.n+ V 



Since Sp(A) = A^/^ G iS, from Proposition 2.1 it follows that {sp,p) is a strong source- 
order pair and p{a) = a^ is strong qualification of the method. However, for every 
A >0, 



lim inf — —^ = lim inf 



a-s>0+ 



P(") 



o-s>0^ 



A ' a e " + 



sm 



Aa 



a 



0. 



Therefore equation (6) does not hold and p{a) = a^ is not optimal qualification of the 
method. 

Example 9. For a, A > define 5'q,(A) as follows: 

g^{X) = X-\l-e-^)-e-^X~^/^ sin(Ai/«) 

so that 

r„(A) = e""+e^^A"^/^ sin(A2/a) . 

It can be immediately verified that {ga} is a SRM which does not have classical 

]_ 

qualification (/io = oo). However, with p{a) = e ^ we have that 

p{a) 



SpW 



lim inf 

a^0+ ra{X) 



1 



lim sup 

«-5-0+ 

Ai 



Vs + A-V2|sin(At/a) 



Since Sp{X) = A^/^ G S, by Proposition 2.1 (sp,p) is a strong source-order pair and 
p{a) = e~^l^ is strong qualification of the method. However, VA > we have that 



lim inf ^ 

a-s>0+ 



^p(A)|r„(A)| 



p[a) 



liminf (A^/^e^ " + I sinfAa/a)! ) = 0, 

a->0+ V / 



and therefore (6) does not hold and pip) = e ^ is not optimal qualification of the 
method. 

Example 10. For < a < 1 and A > define 

g^{\) = A-i(l-e-^) + (lna)-U-=^/2 sin(Ai/a) 
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so that 

r,(A) = e-^-(lna)-^A-^/2 sin(At/a) . 

Just like in Examples 8 and 9 it can be easily checked that {ga} is a SRM which 
does not have classical qualification (yUo = 0), that p{a) = j^ is strong but not optimal 
quahfication of the method and that (sp, p) is a strong source-order pair with Sp{\) = A s . 

Note that examples 2, 3, 4, 6, 9 and 10 correspond to SRMs which do not have 
classical qualification but, however, they do have generalized qualification, falling in 
some of its three different levels. Also Landweber's method and Showalter's method, 
which as previously pointed out do not have classical qualification (in both cases 
/io = oo), are SRMs defined by 5'o(A) = ^(1 — (1 — p^)") (where a < 1, /i < 77^) and 

daW = j{^ — e~«), respectively. It can be easily proved, by using Theorem 2.1, that 
p{a) = (1— yuaa)^ is weak qualification of Landweber's method and p(a) = e ^ is weak 

qualification of Showalter's method. However, in this last case it can be easily shown 
i_ 

that p{a) = e ^ does not satisfy condition (3) and therefore p{a) is not qualification 
in the sense of Definition 1.2. 

The different qualification levels introduced in this article and the relationships 
between them are visualized in Figure 1. 

4. Orders of convergence, converse results and maximal source sets 

The generalization of the concept of qualification of a SRM introduced in the previous 
sections is strongly related with and it has a broad spectrum of applications in the 
context of orders of convergence, converse results and maximal source sets for inverse 
ill-posed problems. We present next some results in this direction. However, we point 
out that this is not the main objective of the present article. For that reason, some of 
this results will be stated without proof. More detailed results in this regard will appear 
in a forthcoming article. 

Let X, Y be infinite dimensional Hilbert spaces and T : X -^Y a, bounded, linear 
invertible operator such that TZ{T) is not closed. For s G 5, the set TZ{s{T*T)), will 
be referred to as the "source set associated to the function s and the operator T". In 
all that follows, the hypothesis s G 5 can be replaced by s continuous on a{T*T) and 
s G A^O; where M.q is the set of all functions / : IR — )■ IR^j" which are measurable with 
respect to the measures d \\Exx\\ for every x G X. 

The following direct result, whose proof follows immediately from the concept of 
weak source-order pair, states that if the exact solution x^ of the problem Tx = y 
belongs to the source set TZ{s{T*T)) and (s,p) is a weak source-order pair for {qo}, 
then the regularization error ||i?Q,y — x^|| has order of convergence p{a). For brevity 
reasons we do not give the proof here. 



Generalized Qualification and Qualification Levels for SRM 



17 



Classical 




[6], Remark 4 




Optimal 



7\ 



V 



/ 



Examples 8, 9 and 10 



Example 7^7 Strong 



Examples 2, 5 and 6 



V 



Qualification in the sense 
of Mathe-Pereverzev ([6]) 



(P continuous) 



Weak 



Showalter's method 




Q<.u^< OC 



Figure 1. Relationships between the different quahfication levels, the classical 
qualification and the qualification defined in [ ]. 



Theorem 4.1. Let p & O be weak qualification of {ga} O'^d s & S such that {s,p) is 
a weak source- order pair for {ga}- If x"^ = T^'y E lZ{s(T*T)) then ||(_Rq — T"'")y|| = 
0{p{a)) fora-^0+. 

It is important to note here that the previous result can be viewed as a 
generahzation of Theorem 4.3 in [2], to the case of SRM with weak quahfication and 
general source sets. In fact, that result corresponds to the particular case in which {ga} 
has classical qualification of order p. 
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The following converse result states that if the regularization error has order of 
convergence p{a) and (p, s) is an order-source pair, then the exact solution belongs to 
the source set given by the range of the operator s(T*T). 

Theorem 4.2. // {p,s) is an order-source pair for {(?«} and \\{Ra ~T'^)y\\ = 0{p{a)) 
for a -^ 0+, then x^ G n{s{T*T)). 

Proof. The proof follows immediately from the definition of order-source pair for the 
SRM {g^}. m 

It is interesting to note that Theorem 4.2 can also be viewed as a generalization of 
Theorem 4.11 in [J]. In fact, this corresponds to the particular case in which s(A) = A'^ 
y p{a) = a^. If moreover p is optimal qualification then the reciprocal of Theorem 4.2 
also holds. This is proved in the following theorem. 

Theorem 4.3. If p is optimal qualification of {go] and Sp E S, then \\{Ra ~T'^)y\\ = 
0{p{a)) for a^0+ if and only if x^ G n{Sp{T*T)). 

Proof. Let p be optimal qualification of {ga} and Sp G S. Then by Theorem 2.3, (p, Sp) 
is an order-source pair for {ga} and since ||(i?Q, — T"!")?/!! = 0{p{a)) for a — )• 0"*", it 
follows from Theorem 4.2 that a;^ G TZ{sp{T*T)). 

Conversely, if x^ G TZ{sp{T*T)), since by virtue of Theorem 2.3 {sp,p) is a strong 
source-order pair. Theorem 4.1 implies that \\{Ra — T'^)y\\ = 0{p{a)) for a — > 0+. ■ 

An important result regarding existence and maximality of source sets is the 
following: if p is strong qualification of a SRM and Sp G iS it follows from Proposition 
2.2 that TZ{sp{T*T)) is a maximal source set where p is order of convergence of the 
regularization error. More precisely we have the following result. 

Theorem 4.4. Let p E O be strong qualification of {ga} such that Sp E S and s E S. 
If (s,p) is a strong source-order pair for {ga} and TZ{s{T*T)) D TZ{sp{T*T)) then 
n{s{T*T)) =n{sp{T*T)). 

Proof. Under the hypotheses of the Proposition 2.2, there exists k > such that 
s(A) < k Sp{X) for every A > 0, which implies that n{s{T*T)) C n{sp{T*T)). ■ 

If moreover p is optimal qualification the following stronger result is obtained. 

Theorem 4.5. If p E O is optimal qualification of {ga} and Sp G S, then IZ{sp{T*T)) 
is the only source set where p is order of convergence of the regularization error of {ga}- 

Proof. This result follows immediately from Theorem 2.3. ■ 

Examples: 

1. For the Tikhonov-Phillips regularization method the only source set where 
p{a) = a is optimal qualification is IZ{sp{T*T)) = 7l(T*T), since in this case Sp{X) = A. 
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2. In Example 3 of Section 3 we saw that p{a) = e~^ is optimal qualification of 
{qo,} and Sp{X) = ^. Since j^ ^ A it follows that n{sp{T*T)) = n{T*T) is the only 
source set where p is order of convergence of the regularization error. 

3. In Example 8 of the previous section, for p{a) = a^ we have that Sp{X) = A^/^. 

Since p is strong qualification of this SRM, it follows that lZ{sp{T*T)) = 7^(T*T)^/^ is 

a maximal source set where p{a) is order of convergence of the regularization error. 

]_ 

4. As pointed out at the end of Section 3, p{a) = e ^ is weak qualification of 

Showalter's method. It can be easily shown that for every s G 5, (s, p) is a weak source- 
order pair for the method. Therefore, it follows from Theorem 4.1 that the regularization 

error \\Ray — x'\\ has order of convergence p{a) = e ^ whenever x^ E [J TZ{s{T*T)). 

se-s 

5. Same as 4. happens with Landweber's method and p(a) = (1 — py/a)^ . 

5. Conclusions 

In this article we have extended the definition of qualification for spectral regularization 
methods introduced by Mathe and Pereverzev in [ ]. This extension was constructed 
bearing in mind the concept of qualification as the optimal order of convergence of the 
regularization error that a method can achieve ([2], [5], [6], [11]). Three different levels 
of generalized qualification were introduced: weak, strong and optimal. In particular, 
the first of these levels extends the definition introduced in [(■] and a SRM having 
weak qualification which is not qualification in the sense of Definition 1.2 was shown. 
Sufficient conditions for a SRM to have weak qualification were provided, as well as 
necessary and sufficient conditions for a given order of convergence to be strong or 
optimal qualification. Examples of all three qualification levels were provided and 
the relationships between them as well as with the classical concept of qualification 
and the qualification introduced in [G] were shown. Several SRMs having generalized 
qualification in each one of the three levels and not having classical qualification were 
presented. In particular, it was shown that the well known TSVD, Showalter's and 
Landweber's methods do have weak qualification. Finally several implications of this 
theory in the context of orders of convergence, converse results and maximal source 
sets for inverse ill-posed problems, were briefiy shown. More detailed results on these 
implications will appear in a forthcoming article. 
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